Wireless receiving apparatus, data processing module, and data processing method, for receiving video image

ABSTRACT

A wireless receiving apparatus includes a plurality of wireless receiving modules that receive a plurality of sub-streams constituting a video frame from a wireless transmitting apparatus and a data processing module that determine whether an error occurs in each of the plurality of sub-streams, in response to determining that an error does not occur in any of the plurality of sub-streams, merges the plurality of sub-streams to generate the video frame, transmits the video frame to a display electrically connected to the wireless receiving apparatus, and in response to determining that an error occurs in at least one of the plurality of sub-streams, transmits an immediately-preceding video frame to the display.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims priority from Korean patent application No.10-2016-0106719, filed on Aug. 23, 2016 in the Korean IntellectualProperty Office, the entire disclosure of which is hereby incorporatedby reference.

BACKGROUND 1. Field

Apparatuses and methods consistent with exemplary embodiments relate toa wireless receiving apparatus, a data processing module, and a dataprocessing method, for receiving a video image.

2. Description of the Related Art

With the advancement of image technology, display devices supportinghigh-definition (HD) image data have been developed. Recently, displaydevices supporting image data of not only HD or full HD (FHD) resolutionbut also ultra HD (UHD) resolution have appeared. Accordingly,technology for transmitting or receiving HD video data through wired orwireless communication has also been developed.

Various technologies for wirelessly transmitting the HD video data havebeen proposed. Conventionally, wireless video transmission technologyhas been based on Wi-Fi of the 2.4 GHz/5 GHz band or wirelessHD (WiHD)and a wireless gigabit alliance (WiGIG) of the 60 GHz band.

The WiHD-based video data transmitting and receiving system may transmitor receive video data of a FHD resolution in real time. However, in acase in which video data of a UHD resolution is transmitted thereto,image quality may be reduced depending on a state of a wireless channel.

SUMMARY

Exemplary embodiments may address at least the above problems and/ordisadvantages and other disadvantages not described above. Also, theexemplary embodiments are not required to overcome the disadvantagesdescribed above, and may not overcome any of the problems describedabove.

Exemplary embodiments provide a wireless transmitting apparatus, a SoC,and a method for stably transmitting video data without image damage orimage degradation even though quality of a wireless channel is not goodwhen transmitting video data of a UHD resolution or higher.

According to an aspect of an exemplary embodiment, there is provided awireless receiving apparatus including: a plurality of wirelessreceivers configured to receive a plurality of sub-streams constitutinga video frame; and a data processor configured to: determine whether anerror occurs in each of the plurality of sub-streams; in response todetermining that an error does not occur in any of the plurality ofsub-streams, merge the plurality of sub-streams to generate the videoframe; transmit the video frame to a display that is electricallyconnected to the wireless receiving apparatus; and in response todetermining that an error occurs in at least one of the plurality ofsub-streams, transmit an immediately-preceding video frame to thedisplay.

The data processor may be further configured to: determine whetherreception of the plurality of sub-streams constituting the video frameis completed using total transmission period information and time indexinformation of a video frame included in a header of each of theplurality of sub-streams; and in response to determining that thereception of the plurality of sub-streams constituting the video frameis not completed, transmit the immediately-preceding video frame to thedisplay.

The data processor may be further configured to, in response todetermining that the reception of the plurality of sub-streamsconstituting the video frame is not completed, temporarily store some ofthe plurality of sub-streams constituting the video frame in a memory.

The data processor may be further configured to, in response todetermining that reception of a remainder of the plurality ofsub-streams constituting the video frame is completed, merge some of theplurality of sub-streams temporarily stored in the memory with theremainder of the plurality of sub-streams to generate the video frame.

The data processor may be further configured to verify channel indexinformation included in a header of the each of the plurality ofsub-streams and merge the plurality of sub-streams in a combinationorder based on the channel index information.

The data processor may be further configured to differentiate a validbit and a dummy bit of a payload of each of the plurality of sub-streamsusing pixel partitioning information included in a header of each of theplurality of sub-streams and merge respective valid bits of theplurality of sub-streams to generate the video frame.

The data processor may be further configured to verify a position of acyclic redundancy check (CRC) code included in each of the plurality ofsub-streams using payload length information included in a header ofeach of the plurality of sub-streams and determine whether an erroroccurs in each of the plurality of sub-streams using the CRC code.

The data processor may be further configured to verify a compressionrate of the video frame using compression rate information included in aheader of each of the plurality of sub-streams, decompress the videoframe to correspond to the compression rate, and transmit thedecompressed video frame to the display.

The data processor may be further configured to convert a format of thevideo frame to a format capable of being played in the display andtransmit the video frame, the format of which is converted, to thedisplay.

According to an aspect of another exemplary embodiment, there isprovided a data processor including: a cyclic redundancy check (CRC)calculator configured to determine whether an error occurs in each of aplurality of sub-streams received from a plurality of wireless receivingapparatuses; a stream merger configured to, in response to determiningthat an error does not occur in any of the plurality of sub-streams,merge the plurality of sub-streams to generate a video frame; and a maincontroller configured to, in response to determining that an error doesnot occur in any of the plurality of sub-streams, transmit the videoframe to a display that is electrically connected to the wirelessreceiving apparatus, and in response to determining that an error occursin at least one of the plurality of sub-streams, transmit animmediately-preceding video frame to the display.

The stream merger may be further configured to determine whetherreception of the plurality of sub-streams constituting the video frameis completed using total transmission period information and time indexinformation of a video frame included in a header of each of theplurality of sub-streams, and in response to determining that thereception of the plurality of sub-streams constituting the video frameis not completed, temporarily store some of the plurality of sub-streamsin a memory.

The stream merger may be further configured to, in response todetermining that reception of a remainder of the plurality ofsub-streams constituting the video frame is completed, merge some of theplurality of sub-streams temporarily stored in the memory with theremainder of the plurality of sub-streams to generate the video frame.

The main controller may be further configured to, in response todetermining that the reception of the plurality of sub-streamsconstituting the video frame is not completed, transmit theimmediately-preceding video frame to the display.

The stream merger may be further configured to verify channel indexinformation included in a header of each of the plurality of sub-streamsand merge the plurality of sub-streams in a combination order based onthe channel index information.

The stream merger may be further configured to differentiate a valid bitand a dummy bit of a payload of each of the plurality of sub-streamsusing pixel partitioning information included in a header of each of theplurality of sub-streams and merge respective valid bits of theplurality of sub-streams to generate the video frame.

The CRC calculator may be further configured to verify a position of aCRC code included in each of the plurality of sub-streams using payloadlength information included in a header of each of the plurality ofsub-streams, and determine whether an error occurs in each of theplurality of sub-streams using the CRC code.

The data processor may further include a decoder configured to verify acompression rate of the video frame using compression rate informationincluded in a header of each of the plurality of sub-streams, decompressthe video frame to correspond to the compression rate, and transmit thedecompressed video frame to the display.

The data processor may further include a video reconstructor configuredto convert a format of the video frame to a format capable of beingplayed in the display and transmit the video frame, the format of whichis converted, to the display.

The data processor may further include a plurality of stream convertersconfigured to receive a plurality of sub-streams from the plurality ofwireless receiving apparatuses, convert a format of the plurality ofsub-streams, and transmit the plurality of sub-streams, the format ofwhich is converted, to the CRC calculator.

According to an aspect of another exemplary embodiment, there isprovided a video reconstructing method of a wireless receivingapparatus, the method including: receiving a plurality of sub-streamsconstituting a video frame; determining whether an error occurs in eachof the plurality of sub-streams; in response to determining that anerror does not occur in any of the plurality of sub-streams, merging theplurality of sub-streams to generate the video frame; transmitting thevideo frame to a display that is electrically connected to the wirelessreceiving apparatus; and in response to determining that an error occursin at least one of the plurality of sub-streams or reception of theplurality of sub-streams is not completed, transmitting animmediately-preceding video frame to the display.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and/or other aspects, features, and advantages will be moreapparent from the following description of exemplary embodiments, takenin conjunction with the accompanying drawings, in which:

FIG. 1 is a block diagram illustrating a wireless transmitting andreceiving system, according to an exemplary embodiment;

FIG. 2 is a block diagram illustrating a configuration of a wirelesstransmitting apparatus, according to an exemplary embodiment;

FIG. 3 is a diagram illustrating a structure of a sub-stream, accordingto an exemplary embodiment;

FIG. 4 is a block diagram illustrating a wireless receiving apparatus,according to an exemplary embodiment;

FIG. 5 is a diagram illustrating an example of video reconstruction of awireless transmitting and receiving system, according to an exemplaryembodiment;

FIG. 6 is a flowchart illustrating a video transmitting method of awireless transmitting apparatus, according to an exemplary embodiment;and

FIG. 7 is a flowchart illustrating a video reconstructing method of awireless receiving apparatus, according to an exemplary embodiment.

DETAILED DESCRIPTION

Reference will now be made in detail to exemplary embodiments withreference to accompanying drawings. Accordingly, those of ordinary skillin the art will recognize that modification, equivalent, and/oralternative on the various exemplary embodiments described herein can bevariously made without departing from the scope and spirit of thepresent disclosure. With regard to description of drawings, similarelements may be marked by similar reference numerals.

In this disclosure, the expressions “have,” “may have,” “include,” and“comprise,” “may include,” and “may comprise” used herein indicateexistence of corresponding features (e.g., elements such as numericvalues, functions, operations, or components) but do not excludepresence of additional features. In this disclosure, the expressions “Aor B,” “at least one of A or/and B,” “one or more of A or/and B,” andthe like may include any and all combinations of one or more of theassociated listed items. For example, the term “A or B,” “at least oneof A and B,” or “at least one of A or B” may refer to all of (1) thecase where at least one A is included, (2) the case where at least one Bis included, or (3) the case where both of at least one A and at leastone B are included.

The terms, such as “first,” “second,” and the like used in thisdisclosure may be used to refer to various elements regardless of theorder and/or the priority and to distinguish the relevant elements fromother elements, but do not limit the elements. For example, “a firstuser device” and “a second user device” indicate different user devicesregardless of the order or priority. For example, a first element may bereferred to as a second element, and similarly, a second element may bereferred to as a first element.

It will be understood that when an element (e.g., a first element) isreferred to as being “(operatively or communicatively) coupled with/to”or “connected to” another element (e.g., a second element), it may bedirectly coupled with/to or connected to the other element or anintervening element (e.g., a third element) may be present. In contrast,when an element (e.g., a first element) is referred to as being“directly coupled with/to” or “directly connected to” another element(e.g., a second element), it should be understood that there are nointervening elements (e.g., a third element).

According to the situation, the expression “configured to” used in thisdisclosure may be used as, for example, the expression “suitable for,”“having the capacity to,” “designed to,” “adapted to,” “made to,” or“capable of.” The term “configured to” must not mean only “specificallydesigned to” in hardware. Instead, the expression “a device configuredto” may mean that the device is “capable of” operating together withanother device or other components. For example, a “processor configuredto (or set to) perform A, B, and C” may mean a dedicated processor(e.g., an embedded processor) for performing a corresponding operationor a generic-purpose processor (e.g., a central processing unit (CPU) oran application processor) which performs corresponding operations byexecuting one or more software programs which are stored in a memorydevice.

Terms used in this disclosure are used to describe exemplary embodimentsand are not intended to limit the scope of the present disclosure. Theterms of a singular form may include plural forms unless otherwisespecified. All the terms used herein, which include technical orscientific terms, may have the same meaning that is generally understoodby a person skilled in the art. It will be further understood thatterms, which are defined in a dictionary and commonly used, should alsobe interpreted as is customary in the relevant related art and not in anidealized or overly formal way unless expressly so defined in variousexemplary embodiments of this disclosure. In some cases, even if termsare terms which are defined in this disclosure, they may not beinterpreted to exclude embodiments of this disclosure.

Throughout the drawings, it should be noted that like reference numbersare used to depict the same or similar elements, features, andstructures.

FIG. 1 is a block diagram illustrating a wireless transmitting andreceiving system, according to an exemplary embodiment.

Referring to FIG. 1, a wireless transmitting and receiving system 1000may include a wireless transmitting apparatus 100 and a wirelessreceiving apparatus 200. According to an aspect of an exemplaryembodiment, the wireless transmitting apparatus 100 may transmit videodata (or a video frame) of a frame unit to the wireless receivingapparatus 200 over a wireless network.

The wireless transmitting apparatus 100 may include data processor (ordata processing circuit) 110 and a plurality of wireless transmitters(or wireless transmitting circuits) 120-1 and 120-2. The wirelesstransmitting apparatus 100 may be a video image source device, and maybe, for example, a set-top box, a smartphone, a tablet personal computer(PC), and a notebook PC.

The data processor 110 of the wireless transmitting apparatus 100 maygenerate a plurality of sub-streams by using the video frame (or thevideo data). Before generating the plurality of sub-streams, the dataprocessor 110 may compress the video frame. For example, the video framemay be content that is received from an external device or stored in aninternal (or external) recording medium. For example, the recordingmedium may include a compact disc (CD), a digital versatile disc (DVD),a hard disk, a Blu-lay disc, a memory card, a universal serial bus(USB), and the like.

The data processor 110 may generate a plurality of sub-streams, whichhave a specified format, by using the video frame. For example, each ofthe plurality of sub-streams may include a header and a cyclicalredundancy check (CRC) code including information about a sub-stream.After changing the format of each of the plurality of sub-streams into afirst video format, the data 110 may transmit the plurality ofsub-streams of first video format to the plurality of wirelesstransmitters 120-1 and 120-2. The first video format may be the videoformat (e.g., a Consumer Electronics Association (CEA) format) that iscapable of being output to a display. For example, the first videoformat may be a video format including red, green, and blue (RGB) rawdata and a synchronization signal (e.g., Vsync, Hsync, or a data enable(DE) signal).

The plurality of wireless transmitters 120-1 and 120-2 may transmit thesub-stream received from the data processor 110 to the plurality ofwireless receivers (or wireless receiving circuits) 210-1 and 210-2 ofthe wireless receiving apparatus 200. Each of the plurality of wirelesstransmitters 120-1 and 120-2 may be a WiHD module. The plurality ofwireless transmitters 120-1 and 120-2 may transmit the plurality ofsub-streams to the plurality of wireless receivers 210-1 and 210-2according to the WiHD standard.

Each of the plurality of wireless transmitters 120-1 and 120-2 mayverify the state of a channel through which video data is transmitted.For example, each of the plurality of wireless transmitters 120-1 and120-2 may receive channel state information from the plurality ofwireless receivers 210-1 and 210-2 of the wireless receiving apparatus200 and may verify the state of the channel based on the receivedchannel state information. For example, the channel state informationmay include a packet error rate (PER) and a signal-to-noise ratio (SNR).The data processor 110 may determine at least one of the compressionrate of the video frame, an amount of data (or a load sharing rate) ofthe video frame to be included in each of the plurality of sub-streams,and the number of sub-streams (or the total transmission period of thevideo frame) based on the channel state information received from eachof the plurality of wireless transmitters 120-1 and 120-2.

Each of the plurality of wireless transmitters 120-1 and 120-2 mayselectively perform pixel partitioning depending on a channel state.Alternatively, the data processor 110 may determine whether each of theplurality of wireless transmitters 120-1 and 120-2 performs the pixelpartitioning, based on the channel state information. If the pixelpartitioning is performed, each of the plurality of wirelesstransmitters 120-1 and 120-2 may remove a part of data included in thesub-stream for robust transmission. If the pixel partitioning isperformed by the plurality of wireless transmitters 120-1 and 120-2, thedata processor 110 may generate the sub-stream in consideration of anarea in which data is to be removed by the pixel partitioning such thatthe data included in the sub-stream is not lost.

The data processor 110 may determine at least one of the compressionrate of the video frame, an amount of data (or a load sharing rate) ofthe video frame to be included in each of the plurality of sub-streams,and the number of sub-streams (or the total transmission period of thevideo frame) based on pixel partitioning information received from atleast one of the plurality of wireless transmitters 120-1 and 120-2.

The wireless receiving apparatus 200 may include a plurality of wirelessreceivers 210-1 and 210-2 and a data processor 220. The wirelessreceiving apparatus 200 may be a video sink device such as a TV, asmartphone, a tablet PC, and a notebook PC. The wireless receivingapparatus 200 may include the display or may be electrically connectedwith a separate display device.

The plurality of wireless receivers 210-1 and 210-2 may receive aplurality of sub-streams from the plurality of wireless transmitters120-1 and 120-2 of the wireless transmitting apparatus 100. Theplurality of wireless receivers 210-1 and 210-2 may be WiHD modules.According to the WiHD standard, each of the plurality of wirelessreceivers 210-1 and 210-2 may receive the plurality of sub-streams. Forexample, the plurality of wireless receivers 210-1 and 210-2 may receivethe sub-stream of the first video format from the plurality of wirelesstransmitters 120-1 and 120-2. The plurality of wireless receivers 210-1and 210-2 may transmit the received plurality of sub-streams to the dataprocessor 220.

Each of the plurality of wireless receivers 210-1 and 210-2 may verifythe state of the channel, through which video data is transmitted, basedon the received video data. The plurality of wireless receivers 210-1and 210-2 may transmit the channel state information (e.g., the PER, theSNR, or the like) to the plurality of wireless transmitters 120-1 and120-2. If it is verified that a part of data is removed by the pixelpartitioning of each of the wireless transmitters 120-1 and 120-2, eachof the wireless receivers 210-1 and 210-2 may insert dummy data into anarea in which the part of the data is removed such that a data structurebefore the data is removed is reconstructed. The reconstructed data maybe transmitted to the data processor 220.

The data processor 220 of the wireless receiving apparatus 200 maygenerate (or reconstruct) the video frame by merging the plurality ofsub-streams received from the plurality of wireless receivers 210-1 and210-2. The wireless receiving apparatus 200 may output the video framethrough the display electrically connected with the wireless receivingapparatus 200. The data processor 220 may determine whether an error hasoccurred in the sub-stream, by using the CRC code included in thesub-stream. If the reception of a video frame is not completed at apoint in time when the video frame is to be output, or if an erroroccurred in the received video frame, the data processor 220 of thewireless receiving apparatus 200 may output the immediately-precedingvideo frame instead of a video frame to be currently output.

The wireless transmitting apparatus 100 and the wireless receivingapparatus 200 may include the plurality of wireless transmitters 120-1and 120-2 and the plurality of wireless receivers 210-1 and 210-2,respectively. Here, the number of wireless transmitters 120-1 and 120-2may be the same as the number of wireless receivers 210-1 and 210-2. Forexample, as illustrated in FIG. 1, the wireless transmitting apparatus100 may include the first wireless transmitters 120-1 and the secondwireless transmitters 120-2, and the wireless receiving apparatus 200may include the first wireless receiver 210-1 and the second wirelessreceiver 210-2.

Each of the plurality of wireless transmitters 120-1 and 120-2 maycommunicate with one of the plurality of wireless receivers 210-1 and210-2. For example, the first wireless transmitters 120-1 maycommunicate with the first wireless receiver 210-1 through a firstwireless channel, and the second wireless transmitters 120-2 maycommunicate with the second wireless receiver 210-2 through a secondwireless channel.

In an aspect of an exemplary embodiment described with reference to FIG.1, the wireless transmitting apparatus 100 and the wireless receivingapparatus 200 are described as including two wireless transmitters andtwo wireless receivers, respectively. However, the number of wirelesstransmitters and the number of wireless receivers are not limitedthereto. For example, the number of wireless transmitters and wirelessreceivers may be three or more.

The WiHD-based transmitting and receiving system may transmit or receivevideo data of a FHD resolution in real time. However, in the case whereUHD video data of an UHD resolution is transmitted, conventionally theimage quality may be reduced depending on the state of a wirelesschannel. According to an aspect of an exemplary embodiment, the wirelesstransmitting apparatus 100 may adjust at least one of the compressionrate of the video frame, an amount of data (or a load sharing rate) ofthe video frame to be included in each of a plurality of sub-streams,and the total transmission period of the video frame depending on thewireless channel state. As a result, the video frame may be stablytransmitted even when the wireless channel quality is low.

According to an aspect of an exemplary embodiment, in the case where thepixel partitioning is performed by wireless transmitters, the wirelesstransmitting apparatus 100 may generate the sub-stream in considerationof the pixel partitioning, thereby preventing data from being lost dueto the pixel partitioning.

After dividing the video frame into a plurality of sub-streams, thewireless transmitting apparatus 100 may transmit the divided pluralityof sub-streams and may add information (e.g., the CRC code) fordetermining whether an error occurs, to each of the plurality ofsub-streams. Therefore, the wireless transmitting apparatus 100 mayallow the wireless receiving apparatus 200 to easily determine whetheran error occurs in the video frame, independently of the error detectionby a wireless transmitter and a wireless receiver.

In the case where an error occurs in the received video frame or in thecase where the reception of the video frame is delayed, the wirelessreceiving apparatus 200 may output an alternative video frame (e.g., animmediately-preceding video frame), thereby allowing the user toperceive the degradation of image quality or image errors to a lesserdegree.

FIG. 2 is a block diagram illustrating a configuration of a wirelesstransmitting apparatus, according to an exemplary embodiment.

Referring to FIG. 2, the wireless transmitting apparatus 100 may includethe data processor 110 and the plurality of wireless transmitters 120-1and 120-2. According to an aspect of an exemplary embodiment, the dataprocessor 110 may include an encoder 111, a sub-stream generator 113,and a plurality of format converters 115-1 and 115-2. The elements ofthe data processor 110 illustrated in FIG. 2 may be a separate hardwaremodule or may be a software module implemented by at least oneprocessor. For example, the function of each of modules or componentsincluded in the data processor 110 may be performed by one processor ormay be performed by multiple processors. The data processor 110 may beimplemented with a SoC including at least one processor, a memory, andthe like.

The encoder 111 may compress a video frame. The encoder 111 may performlossless compression or visually lossless compression. In some exemplaryembodiments, the encoder 111 may be omitted.

The encoder 111 may receive the video frame of a first video format. Thefirst video format may be a video format (e.g., a CEA format) that iscapable of being output to a display. For example, the first videoformat may be a video format including RGB raw data and asynchronization signal (e.g., Vsync, Hsync or a DE signal). The encoder111 may select and compress only RGB raw data of data included in thevideo frame, other than a synchronization signal.

The encoder 111 may determine whether the video frame is compressed,based on the resolution of the video frame. For example, if theresolution of the video frame is greater than a first specifiedreference (e.g., FHD (1920×1080) or UHD (3840×2260)), the encoder 111may perform compression (e.g., compressing a video frame of the UHDresolution into a video frame of FHD resolution or HD resolution). Ifthe resolution of the video frame is less than the first specifiedreference, the encoder 111 may not perform compression.

The encoder 111 may determine whether the video frame is compressed, anda compression rate based on channel state information received from theplurality of wireless transmitters 120-1 and 120-2. For example, if achannel state information is not less than a second specified referencevalue (e.g., the channel state indicates a state value greater than thesecond specified reference value) compared with the resolution of thevideo frame, the encoder 111 may not perform the compression. If thechannel state is less than the second specified reference value (e.g.the channel state indicates a state value that is less than the secondspecified reference value), the encoder 111 may perform the compression.As another example, as the channel state improves, the encoder 111 maydecrease the compression rate of the video frame. As the channel statedeteriorates, the encoder 111 may increase the compression rate of thevideo frame.

The encoder 111 may determine the compression rate of the video framebased on the representative value of the channel state information ofthe plurality of wireless transmitters 120-1 and 120-2. For example, theencoder 111 may determine the compression rate of the video frame basedon an average value, a maximum value, or a minimum value of the channelstate information received from each of the plurality of wirelesstransmitters 120-1 and 120-2.

The sub-stream generator 113 may generate a plurality of sub-streams byusing the (compressed or uncompressed) video frame. In the case wherethe compression is not performed by the encoder 111, the sub-streamgenerator 113 may receive the video frame of a first video format. Ifthe video frame of the first video format is received, the sub-streamgenerator 113 may generate a plurality of sub-streams by using only theRGB raw data that excludes a data synchronization signal from dataincluded in the video frame. The sub-stream generator 113 may divide thevideo frame into a plurality of data groups. The sub-stream generator113 may generate the plurality of sub-streams after inserting a headerand a CRC code into each of the divided data groups. The structure of asub-stream will be described with reference to FIG. 3.

The sub-stream generator 113 may determine an amount of data (or a loadsharing rate) of the video frame to be included in each of the pluralityof sub-streams based on the channel state information received from eachof the plurality of wireless transmitters 120-1 and 120-2. Thesub-stream generator 113 may increase the amount of data to be includedin the sub-stream transmitted through a wireless transmitter of whichthe channel state is relatively good (e.g., above a predeterminedquality measurement value). The sub-stream generator 113 may decreasethe amount of data to be included in the sub-stream transmitted througha wireless transmitter of which the channel state is relatively bad(e.g., below a predetermined quality measurement value).

The sub-stream generator 113 may generate the sub-stream, the number ofwhich corresponds to a multiple of the number of wireless transmitters,by using one video frame. For example, as illustrated in FIG. 2, in thecase where the wireless transmitting apparatus 100 includes two wirelesstransmitters 120-1 and 120-2, the sub-stream generator 113 may generatesub-streams of 2×n by using one video frame.

The sub-stream generator 113 may determine the number of sub-streams (orthe total transmission period of the video frame) based on the channelstate information received from each of the plurality of wirelesstransmitters 120-1 and 120-2. The sub-stream generator 113 may determinewhether one video frame is capable of being transmitted within aspecified transmission period, by using the channel state information.For example, the sub-stream generator 113 may store first mappinginformation obtained by mapping the channel state information and themaximum amount of data information corresponding to the channel stateinformation (e.g., in an internal memory). The sub-stream generator 113may determine whether the video frame is capable of being transmittedwithin the specified transmission period, with reference to the firstmapping information. For example, when the channel state is normal(e.g., the channel state information is not less than a third specifiedreference), the specified transmission period may indicate a timerequired to transmit one video frame.

If one video frame is capable of being transmitted within the specifiedtransmission period, the sub-stream generator 113 may generatesub-streams of the same number (e.g., two) as the number of wirelesstransmitters. For example, the sub-stream generator 113 may generate afirst sub-stream and a second sub-stream, which are to be transmittedduring the specified transmission period, by using one video frame. Ifone video frame is not capable of being transmitted within the specifiedtransmission period, the sub-stream generator 113 may generatesub-streams, the number (e.g., four or six) of which is greater than thenumber of wireless transmitters. For example, the sub-stream generator113 may generate the first sub-stream and the second sub-stream, whichare to be transmitted during a first transmission period, by using apart of the video frame. The sub-stream generator 113 may generate athird sub-stream and a fourth sub-stream, which are to be transmittedduring a second transmission period, by using the remaining part of thevideo frame.

In the case where the sub-stream generator 113 generates sub-streams ofthe number greater than the number of wireless transmitters, thesub-stream generator 113 may skip the generation of sub-streams usingthe next video frame. For example, in the case where the sub-streamgenerator 113 generates sub-streams, which are to be transmitted duringtwo transmission periods, by using a first video frame, the sub-streamgenerator 113 may skip the generation of sub-streams using a secondvideo frame and may generate a plurality of sub-streams using a thirdvideo frame.

After changing each of the plurality of sub-streams into a sub-stream ofa second video format capable of being supported according to the WiHDstandard, the plurality of format converters 115-1 and 115-2 maytransmit the sub-stream of the second video format to the plurality ofwireless transmitters 120-1 and 120-2, respectively.

Each of the plurality of wireless transmitters 120-1 and 120-2 maytransmit a sub-stream of the second video format received from the dataprocessor 110 to the wireless receiving apparatus 200 according to theWiHD standard. Each of the plurality of wireless transmitters 120-1 and120-2 may correspond to a media access control (MAC) layer and aphysical (PHY) layer that are defined in the WiHD standard. Afterinserting a CRC code into the sub-stream, each of the plurality ofwireless transmitters 120-1 and 120-2 may perform channel coding andmodulation. Each of the plurality of wireless transmitters 120-1 and120-2 may select at least one of channels of a frequency band (e.g., aband of 60 GHz) defined in the WiHD standard and may transmit thesub-stream through the selected channel in units of a packet. Each ofthe plurality of wireless transmitters 120-1 and 120-2 may monitor thechannel state and may transmit the channel state information to the dataprocessor 110.

Each of the plurality of wireless transmitters 120-1 and 120-2 mayperform pixel partitioning depending on the channel state. For example,if the channel state information is not greater than a fourth specifiedreference, the plurality of wireless transmitters 120-1 and 120-2 mayremove a part of the data included in the sub-stream for robusttransmission. As the channel state becomes worse, the plurality ofwireless transmitters 120-1 and 120-2 may increase a removal rate ofdata. In the case where each of the plurality of wireless transmitters120-1 and 120-2 performs the pixel partitioning, each of the pluralityof wireless transmitters 120-1 and 120-2 may transmit pixel partitioninginformation to the sub-stream generator 113. For example, the pixelpartitioning information may be information indicating the configurationform (e.g., a ratio, a location, or the like) of actual data and dummydata included in the sub-stream to be transmitted to the wirelessreceiving apparatus 200.

The encoder 111 may determine the compression rate of the video framebased on the pixel partitioning information. For example, as the ratioof the dummy data becomes higher (or as the ratio of actual data becomeslower), the encoder 111 may increase the compression rate of the videoframe. As the ratio of the dummy data becomes lower (or as the ratio ofactual data becomes higher), the encoder 111 may decrease thecompression rate of the video frame.

If the pixel partitioning is performed by the plurality of wirelesstransmitters 120-1 and 120-2, the sub-stream generator 113 may generatethe sub-stream based on the pixel partitioning information inconsideration of an area in which data is removed by the pixelpartitioning such that data included in the sub-stream is not lost. Forexample, the sub-stream generator 113 may generate the sub-stream suchthat the video data is included in an area in which the data is notremoved by the pixel partitioning.

The sub-stream generator 113 may determine the amount of data to beincluded in the plurality of sub-streams based on the pixel partitioninginformation. If only a part of the plurality of wireless transmitters120-1 and 120-2 performs the pixel partitioning, the amount of data ofthe sub-stream to be transmitted through a wireless transmitterperforming the pixel partitioning may decrease and the amount of data ofthe sub-stream to be transmitted through a wireless transmitter notperforming the pixel partitioning may increase. As the channel statebecomes worse, the ratio of actual data in the pixel partitioninginformation may decrease and the ratio of dummy data in the pixelpartitioning information may increase. As the ratio of actual data inthe pixel partitioning information becomes higher, the sub-streamgenerator 113 may increase the amount of data to be included in thesub-stream. As the ratio of actual data becomes lower, the sub-streamgenerator 113 may decrease the amount of data to be included in thesub-stream.

The sub-stream generator 113 may determine the number of sub-streams (orthe total transmission period of the video frame) based on the pixelpartitioning information. The sub-stream generator 113 may determinewhether one video frame is transmitted within a specified transmissionperiod, by using the pixel partitioning information. For example, thesub-stream generator 113 may store second mapping information obtainedby mapping a ratio of the actual data to the dummy data and the maximumamount of data information corresponding to the ratio of the actual datato the dummy data (e.g., in an internal memory). The sub-streamgenerator 113 may determine whether the video frame is capable of beingtransmitted within the specified transmission period, based on thesecond mapping information.

If one video frame is capable of being transmitted within the specifiedtransmission period, the sub-stream generator 113 may generatesub-streams of the same number (e.g., two) as the number of wirelesstransmitters. If one video frame is not capable of being transmittedwithin the specified transmission period, the sub-stream generator 113may generate sub-streams, the number (e.g., four or six) of which isgreater than the number of wireless transmitters.

FIG. 3 is a diagram illustrating a structure of a sub-stream, accordingto an exemplary embodiment.

Referring to FIG. 3, the sub-stream may include a first header 21, asecond header 23, a payload 25, and a CRC field 27.

According to an aspect of an exemplary embodiment, the first header 21may include a version field VERSION, a partitioning type fieldPART_TYPE, a SST field, a SSN field, a WT field, a WN field, a CR field,and a FSEQ field. For example, the first header 21 may have a size of 32bits.

The version field VER may include version information of the sub-stream.For example, the version information may be information indicating thestructure of the sub-stream. The wireless receiving apparatus 200 mayverify the structure of the sub-stream, which is generated by thewireless transmitting apparatus 100, by using the version information.The wireless receiving apparatus 200 may reconstruct a video frame byusing a plurality of sub-streams depending on the verified structure ofthe sub-stream. In the case where the structure of the sub-stream isdefined in advance between the wireless transmitting apparatus 100 andthe wireless receiving apparatus 200, the version field VER may beomitted. The number of bits of each field included in the first header21 and the second header 23 may vary depending on the versioninformation, and the version information may be used to determine thenumber of bits of each of the fields.

The partitioning type field PART_TYPE may include pixel partitioninginformation. The pixel partitioning information may be informationindicating the configuration form (e.g., a ratio, a location, or thelike) of actual data and dummy data included in the sub-stream to betransmitted to the wireless receiving apparatus 200. The pixelpartitioning information may include a value indicating a state where awireless transmitter does not perform pixel partitioning. For example,in the case where the pixel partitioning is not performed by thewireless transmitter, the partitioning type field PART_TYPE may be setto ‘0’.

The SST field may include the total transmission period information ofthe video frame. The total transmission period information may refer tototal transmission period information set to transmit one video frame.The total period information may be related to the total number ofsub-streams generated from one video frame. For example, in the casewhere one video frame is divided into two sub-streams and the twosub-streams are transmitted through the first wireless transmitter 120-1and the second wireless transmitter 120-2 during one transmissionperiod, the SST field of each of the sub-streams may be set to ‘0’. Asanother example, in the case where one video frame is divided into foursub-streams and the four sub-streams are transmitted through the firstwireless transmitter 120-1 and the second wireless transmitter 120-2during two transmission periods, the SST field of each of thesub-streams may be set to ‘1’.

The SSN field may include time index information of the sub-stream. Thetime index information may be time division information of a pluralityof sub-streams and may be time index information of a plurality ofsub-streams to be transmitted during a plurality of transmissionperiods. For example, in the case where one video frame is divided intofour sub-streams and the four sub-streams are transmitted through thefirst wireless transmitter 120-1 and the second wireless transmitter120-2 during two transmission periods, the SSN field of each of twosub-streams to be transmitted during a first transmission period may beset to ‘0’, and the SSN field of each of two sub-streams to betransmitted during a second transmission period may be set to ‘1’.

The WT field may include information about the total number of wirelesschannels. For example, the information about the total number ofwireless channels may correspond to the number of wireless transmitters(or the number of wireless channels formed to transmit sub-streamsbetween a plurality of wireless transmitters and a plurality of wirelessreceivers). For example, in the case where the number of wirelesschannels is two, the WT field may be set to ‘1’. As another example, inthe case where the number of wireless channels is three, the WT fieldmay be set to ‘2’.

The WN field may include channel index information. The channel indexinformation may be information for identifying a channel (or a wirelesstransmitter transmitting the sub-stream) through which the sub-stream istransmitted. For example, in the case where there are a first wirelesschannel and a second wireless channel for transmitting sub-streams, theWN field of a sub-stream to be transmitted through the first wirelesschannel may be set to ‘0’, and the WN field of a sub-stream to betransmitted through the second wireless channel may be set to ‘1’. Whengenerating the video frame by merging a plurality of sub-streams, thewireless receiving apparatus 200 may determine a combination order ofthe plurality of sub-streams by using the channel index information.

The CR field may include compression rate information of the videoframe. For example, the compression rate information may be informationabout a rate at which the data processor 110 compresses the video frame.For example, in the case where the compression rate of the video frameis ¼, the CR field may be set to ‘0’. As another example, in the casewhere the compression rate of the video frame is ⅛, the CR field may beset to ‘1’.

The FSEQ field may include sequence information of the video frame. Thesequence information may indicate the sequence of the video frame, whichis currently transmitted, from among all video frames. The wirelessreceiving apparatus 200 may transmit the video frame to a displaydepending on the sequence information of the video frame. The FSEQ fieldmay be omitted.

According to an aspect of an exemplary embodiment, the second header 23may include a LD_BAL field and a LEN field. For example, the secondheader 23 may have a size of 32 bits.

The LD_BAL field may include load balancing rate information. Forexample, the load balancing rate information may indicate the ratio ofvideo data to be transmitted through each of a plurality of wirelesschannels (or the ratio of video data included in a plurality ofsub-streams to be transmitted during one transmission period). Forexample, in the case where the amount of video data to be transmittedthrough a first wireless channel is the same as the amount of video datato be transmitted through a second wireless channel, the LD_BAL field ofthe plurality of sub-streams may be set to a value corresponding to 1:1.As another example, in the case where the amount of video data to betransmitted through a first wireless channel is twice the amount ofvideo data to be transmitted through a second wireless channel, theLD_BAL field of the plurality of sub-streams may be set to a valuecorresponding to 2:1. For example, the LD_BAL field may have a size of 4bits.

The LEN field may include length information of a payload of asub-stream. The length information of the payload may be used such thatthe wireless receiving apparatus 200 differentiates the video data(i.e., payload) and a CRC code included in the sub-stream. For example,the LEN field may have a size of 28 bits.

The first header 21 and the second header 23 described with reference toFIG. 3 are merely exemplary and various embodiments are not limitedthereto. For example, a type and the number of bits of each of thefields included in each of the first header 21 and the second header 23may be variously set depending on an exemplary embodiment. In addition,a part of the fields included in the first header 21 may be included inthe second header 23 or a part of the fields included in the secondheader 23 may be included in the first header 21.

According to an aspect of an exemplary embodiment, the payload 25 mayinclude video data. The payload 25 may include a part of the video dataconstituting the video frame.

The CRC field 27 may include the CRC code. For example, the CRC field 27may include the CRC code calculated by using at least a part of thefirst header 21, the second header 23, and the payload 25. For example,the CRC field 27 may have a size of 32 bits. The wireless receivingapparatus 200 may determine whether an error occurs, by using the CRCcode inserted into the sub-stream independently of an error check thatthe wireless transmitter and wireless receiver perform.

FIG. 4 is a block diagram illustrating a wireless receiving apparatus,according to an exemplary embodiment.

Referring to FIG. 4, the wireless receiving apparatus 200 may includethe first wireless receiver 210-1, the second wireless receiver 210-2,and the data processor 220. According to an aspect of an exemplaryembodiment, the data processor 220 may include a synchronizationcontroller 221, a plurality of stream converters 222-1 and 222-2, aplurality of CRC calculators 223-1 and 223-2, a stream merger 224,storage 225 (e.g., memory), a decoder 226, a video reconstructor 227,and a main controller 228. The elements of the data processor 220illustrated in FIG. 4 may be a separate hardware module or may be asoftware module implemented by at least one processor. For example, thefunction of each of the modules included in the data processor 220 maybe performed by one processor or may be performed by each separateprocessor. The data processor 220 may be implemented with a SoCincluding at least one processor, a memory, and the like.

The plurality of wireless receivers 210-1 and 210-2 may receive aplurality of sub-streams from the plurality of wireless transmitters120-1 and 120-2 of the wireless transmitting apparatus 100,respectively. Each of the plurality of wireless receivers 210-1 and210-2 may be a WiHD module. The plurality of wireless receivers 210-1and 210-2 may receive sub-streams having the second video format fromthe plurality of wireless transmitters 120-1 and 120-2, respectively.The plurality of wireless receivers 210-1 and 210-2 may transmit thereceived plurality of sub-streams to the synchronization controller 221.If it is verified that a part of data is removed by pixel partitioningof each of the wireless transmitters 120-1 and 120-2, each of thewireless receivers 210-1 and 210-2 may insert dummy data into an area inwhich the data is removed such that data structure before the data isremoved is reconstructed, and may transmit the reconstructed data to thedata processor 220.

The synchronization controller 221 may synchronize a plurality ofsub-streams received from the plurality of wireless receivers 210-1 and210-2. For example, the sub-streams received from the plurality ofwireless receivers 210-1 and 210-2 may be of the second video format(e.g., a video format (e.g., a CEA format) capable of being output to adisplay). The synchronization controller 221 may synchronize theplurality of sub-streams by using a synchronization signal (e.g., aVsync signal, a Hsync signal, a DE signal, or the like) included in thesub-streams. The synchronization controller 221 may transmit thesynchronized plurality of sub-streams to the plurality of streamconverters 222-1 and 222-2.

Each of the plurality of stream converters 222-1 and 222-2 may interpretheader information of each of the sub-streams received from thesynchronization controller 221. Each of the plurality of streamconverters 222-1 and 222-2 may change the format of the sub-streamsreceived from the synchronization controller 221 by using the headerinformation. The interpreted header information may be transmitted tothe main controller 228. The plurality of stream converters 222-1 and222-2 may transmit a plurality of sub-streams, of which the format ischanged, to the plurality of CRC calculators 223-1 and 223-2,respectively.

Each of the plurality of CRC calculators 223-1 and 223-2 may extract aCRC code included in each of the sub-streams received from the pluralityof stream converters 222-1 and 222-2. For example, the plurality of CRCcalculators 223-1 and 223-2 may verify a location of the CRC codeincluded in each of the sub-streams by using length information of apayload included in a LEN field of the header of each of the sub-streamsand may extract the CRC code from the verified location. Each of theplurality of CRC calculators 223-1 and 223-2 may calculate the CRC codeby using a sub-stream in the same manner as that of the wirelesstransmitting apparatus. Each of the plurality of CRC calculators 223-1and 223-2 may determine whether an error has occurred in the sub-stream,by comparing the CRC code extracted from the sub-stream with thecalculated CRC code. Each of the plurality of CRC calculators 223-1 and223-2 may transmit information about whether an error has occurred inthe sub-stream, to the stream merger 224.

The stream merger 224 may receive the sub-stream from the plurality ofstream converters 222-1 and 222-2 or the plurality of CRC calculators223-1 and 223-2. The stream merger 224 may generate (or reconstruct) avideo frame by merging a plurality of sub-streams. The stream merger 224may generate the video frame by merging the sub-stream (or a normalsub-stream) in which the comparison result of the CRC code indicatesthat an error has not occurred. For example, if an error does notoccurred in all the plurality of sub-streams constituting one videoframe, the stream merger 224 may generate the video frame. If an errorhas occurred in at least one of the plurality of sub-streams, the streammerger 224 may not generate the video frame.

The stream merger 224 may merge the plurality of sub-streams in acombination order that is based on a channel index, by using the totalnumber of wireless channels and channel index information that arerespectively included in a WT field of a header and a WN field. Thestream merger 224 may differentiate the payload and the CRC code basedon the length information of the payload included in the LEN field ofthe header and may generate the video frame by combining pieces of videodata included in the payload of the sub-stream. The stream merger 224may differentiate a valid bit (or actual data) and a dummy bit (or dummydata) in the payload by using pixel partitioning information included ina partitioning type field PART_TYPE of the header and may generate thevideo frame by selectively merging only the valid bit.

The plurality of sub-streams that constitute one video frame dependingon a wireless channel state may be received during a plurality oftransmission periods. As such, whenever the sub-stream is received, thestream merger 224 may determine whether the reception of the pluralityof sub-streams corresponding to one video frame is completed. Forexample, the stream merger 224 may determine whether the reception of aplurality of sub-streams constituting the video frame is completed, byusing total transmission period information of the video frame and timeindex information that are respectively included in a SST field and aSSN field of the header. If the reception of the video frame is notcompleted, the stream merger 224 may temporarily store a sub-stream intothe storage 225. If the reception of the plurality of sub-streamsconstituting one video frame is completed, the stream merger 224 maygenerate the video frame by merging currently input sub-stream andtemporarily stored sub-stream.

The storage 225 may store the video frame generated by the stream merger224. The storage 225 may store a part of the plurality of sub-streamsconstituting one video frame. The storage 225 may include at least onememory that is included in the data processor 220 or included outsidethe data processor 220 and is electrically connected with the dataprocessor 220.

The decoder 226 may decompress (e.g., decode) the video frame stored inthe storage 225. For example, the decoder 226 may reconstruct the videoframe of a FHD resolution or a HD resolution into the video frame of aUHD resolution. The decoder 226 may decompress the video frame based oncompression rate information included in a CR field of the header. Forexample, in the case where a compression rate is ¼, the decoder 226 maydecompress the video frame such that the resolution of the reconstructedvideo increases four times. As another example, in the case where thecompression rate is ⅛, the decoder 226 may decompress the video framesuch that the resolution of the reconstructed video increases eighttimes. According to some exemplary embodiments, the decoder 226 may beomitted.

The video reconstructor 227 may change the format of the decompressedvideo frame into the first video format. For example, the videoreconstructor 227 may reconstruct the format of the decompressed videoframe into the first video format that is capable of being output to adisplay (e.g., compatible with the display). For example, the firstvideo format may be a CEA format or a high definition multimediainterface (HDMI) format. According to some exemplary embodiments, thevideo reconstructor 227 may be omitted.

The main controller 228 may verify a structure (or a format) of thesub-stream by using version information included in a version field VERof a header. The main controller 228 may control each of elementsincluded in the data processor 220 based on the verified structure ofthe sub-stream.

The main controller 228 may verify a wireless channel state. Forexample, the main controller 228 may verify the state of each of theplurality of wireless channels with reference to at least one of pixelpartitioning information included in the partitioning type fieldPART_TYPE of the header of the sub-stream, load balancing rateinformation included in a LD_BAL field thereof, total transmissionperiod information included in the SST field thereof, and channel stateinformation received from the plurality of wireless receivers 210-1 and210-2. If the wireless channel state continues to deteriorate, the maincontroller 228 may warn a user of channel degradation.

The main controller 228 may select a video frame, which is to be outputto a display, from the video frame stored in the storage 225, and maygenerate a control signal indicating the transmission of the video frameto the display. The decoder 226 and the video reconstructor 227 mayperform the decompression and the format conversion of the selectedvideo frame in response to the control signal of the main controller 228and may transmit the performed result to the display.

The main controller 228 may select the video frame, which is to betransmitted to the display, based on whether an error has occurred inthe sub-stream. For example, in the case where there is no error in theplurality of sub-streams, the main controller 228 may merge theplurality of sub-streams and may direct the decoder 226 and the videoreconstructor 227 to transmit the generated video frame to the display.As another example, in the case where an error has occurred in at leastone of the plurality of sub-streams, the main controller 228 may directthe decoder 226 and the video reconstructor 227 to transmit theimmediately-preceding video frame to the display. For example, theimmediately-preceding video frame may indicate a video frame that isgenerated immediately before a video frame in which an error hasoccurred.

The main controller 228 may select the video frame, which is to betransmitted to the display, based on whether the reception of aplurality of sub-streams constituting one video frame is completed. Forexample, a plurality of sub-streams constituting one video frame may bereceived during two transmission periods. If a part of the plurality ofsub-streams is received during a first transmission period, the maincontroller 228 may direct the decoder 226 and the video reconstructor227 to transmit the immediately-preceding video frame to the display.Afterwards, if the reception of the remaining part of the plurality ofsub-streams is completed during a second transmission period, the maincontroller 228 may merge the sub-stream received during the firsttransmission period and the sub-stream received during the secondtransmission period and may direct the decoder 226 and the videoreconstructor 227 to transmit the generated video frame to the display.

The wireless receiving apparatus 200 may determine whether an error hasoccurred, by using the CRC code inserted into the sub-streamindependently of an error check that a wireless receiver moduleperforms. Accordingly, the wireless receiving apparatus 200 mayaccurately determine whether the received video frame is damaged.

In the case where an error has occurred in the received video frame orin the case where the reception of the video frame is delayed, thewireless receiving apparatus 200 may output an alternative video frame(e.g., an immediately-preceding video frame), thereby allowing the userto perceive the degradation of image quality or image errors to a lesserdegree.

Since a UHD video is transmitted by using a frequency bandwidth of a FHDvideo, a wireless transmission service of the UHD video may be stablyprovided by using a conventional wireless transmitting and receiver.

FIG. 5 is a diagram illustrating an example of video reconstruction of awireless transmitting and receiving system, according to an exemplaryembodiment.

A plurality of sub-streams is exemplified in FIG. 5 as being transmittedthrough two wireless channels. A source video illustrated in FIG. 5 maybe a video frame that is transmitted to the data processor 110 of thewireless transmitting apparatus 100. The sub-stream may be a pluralityof sub-streams that are generated based on the video frame by the dataprocessor 110. The reconstructed video may be the video framereconstructed by the data processor 220 of the wireless receivingapparatus 200.

Referring to FIG. 5, at a first time point t1, the wireless transmittingapparatus 100 may transmit two sub-streams, which is generated by usingan N-th video frame, to the wireless receiving apparatus 200 through twowireless channels. At a second time point t2, the wireless receivingapparatus 200 may verify that there is no error in two sub-streamsconstituting the N-th video frame, and may output the N-th video frameto a display. The wireless receiving apparatus 200 may store thesuccessfully received N-th video frame in the storage 225.

At the second time point t2, the wireless transmitting apparatus 100 maytransmit two sub-streams, which are generated by using a (N+1)-th videoframe, to the wireless receiving apparatus 200 through two wirelesschannels. At a third time point t3, the wireless receiving apparatus 200may verify that there is no error in two sub-streams constituting the(N+1)-th video frame, and may output the (N+1)-th video frame to thedisplay. The wireless receiving apparatus 200 may store the successfullyreceived (N+1)-th video frame in the storage 225.

At the third time point t3, the wireless transmitting apparatus 100 maytransmit two sub-streams, which is generated by using a (N+2)-th videoframe, to the wireless receiving apparatus 200 through two wirelesschannels. A transmission error may occur in at least one of twosub-streams constituting the (N+2)-th video frame. At a fourth timepoint t4, the wireless receiving apparatus 200 may verify the occurrenceof an error in at least one of sub-streams constituting the (N+2)-thvideo frame and may output the (N+1)-th video frame stored in thestorage 225 to the display instead of the (N+2)-th video frame.

At the fourth time point t4, the wireless transmitting apparatus 100 maytransmit two sub-streams, which is generated by using a (N+3)-th videoframe, to the wireless receiving apparatus 200 through two wirelesschannels. At a fifth time point t5, the wireless receiving apparatus 200may verify that there is no error in two sub-streams constituting the(N+3)-th video frame, and may output the normally received (N+3)-thvideo frame to the display. The wireless receiving apparatus 200 maystore the successfully received (N+3)-th video frame in the storage 225.

At the fourth time point t4 and the fifth time point t5, the wirelesstransmitting apparatus 100 may verify channel degradation and maygenerate two (stream (N+4, 0, 0) and stream (N+4, 1, 0)) of foursub-streams constituting a (N+4)-th video frame by using a part of the(N+4)-th video frame. At the fifth time point t5, the wirelesstransmitting apparatus 100 may transmit two (stream (N+4, 0, 0) andstream (N+4, 1, 0)) of four sub-streams constituting the (N+4)-th videoframe to the wireless receiving apparatus 200 through two wirelesschannels. At a sixth time point t6, the wireless receiving apparatus 200may verify that there is no error in the received two sub-streams andmay verify that the reception of all sub-streams constituting the(N+4)-th video frame is not completed. As such, the wireless receivingapparatus 200 may output the (N+3)-th video frame stored in the storage225 to the display. The wireless receiving apparatus 200 may temporarilystore the received two sub-streams (stream (N+4, 0, 0) and stream (N+4,1, 0)) in the storage 225.

Between the fifth time point t5 and the sixth time point t6, thewireless transmitting apparatus 100 may generate the remaining two(stream (N+4, 0, 1) and stream (N+4, 1, 1)) of four sub-streamsconstituting the (N+4)-th video frame by using the remaining part of the(N+4)-th video frame. At the sixth time point t6, the wirelesstransmitting apparatus 100 may transmit the remaining two (stream (N+4,0, 1) and stream (N+4, 1, 1)) of four sub-streams constituting the(N+4)-th video frame to the wireless receiving apparatus 200 through twowireless channels. At a seventh time point t7, the wireless receivingapparatus 200 may verify that there is no error in the received twosub-streams and may verify that the reception of all sub-streamsconstituting the (N+4)-th video frame is completed. The wirelessreceiving apparatus 200 may reconstruct the (N+4)-th video frame bymerging all sub-streams constituting the (N+4)-th video frame and mayoutput the reconstructed (N+4)-th video frame to the display. Thewireless receiving apparatus 200 may store the normally received(N+4)-th video frame in the storage 225.

Between the sixth time point t6 and the seventh time point t7, thewireless transmitting apparatus 100 may skip the generation ofsub-streams using a (N+5)-th video frame and may generate two (stream(N+6, 0, 0) and stream (N+6, 1, 0)) of four sub-streams constituting a(N+6)-th video frame by using a part of the (N+6)-th video frame. At theseventh time point t7, the wireless transmitting apparatus 100 maytransmit two (stream (N+6, 0, 0) and stream (N+6, 1, 0)) of foursub-streams constituting the (N+6)-th video frame to the wirelessreceiving apparatus 200 through two wireless channels. At an eighth timepoint t8, the wireless receiving apparatus 200 may verify that there isno error in the received two sub-streams and may verify that thereception of all sub-streams constituting the (N+6)-th video frame isnot completed. As such, the wireless receiving apparatus 200 may outputthe (N+4)-th video frame stored in the storage 225 to the display. Thewireless receiving apparatus 200 may temporarily store the received twosub-streams (stream (N+6, 0, 0) and stream (N+6, 1, 0)) in the storage225.

Between the seventh time point t7 and the eighth time point t8, thewireless transmitting apparatus 100 may generate the remaining two(stream (N+6, 0, 1) and stream (N+6, 1, 1)) of four sub-streamsconstituting the (N+6)-th video frame by using the remaining part of the(N+6)-th video frame. At the eighth time point t8, the wirelesstransmitting apparatus 100 may transmit the remaining two (stream (N+6,0, 1) and stream (N+6, 1, 1)) of four sub-streams constituting the(N+6)-th video frame to the wireless receiving apparatus 200 through twowireless channels. At a ninth time point t9, the wireless receivingapparatus 200 may verify that there is no error in the received twosub-streams and may verify that the reception of all sub-streamsconstituting the (N+6)-th video frame is completed. The wirelessreceiving apparatus 200 may reconstruct the (N+6)-th video frame bymerging all sub-streams constituting the (N+6)-th video frame and mayoutput the reconstructed (N+6)-th video frame to the display. Thewireless receiving apparatus 200 may store the successfully received(N+6)-th video frame in the storage 225.

According to an exemplary embodiment described with reference to FIG. 5,in the case where an error occurs in a video frame due to wirelesschannel degradation or in the case where the data transmission rate of awireless channel is low, the wireless receiving apparatus 200 may outputthe immediately-preceding video frame to the display, and thus thewireless receiving apparatus 200 may allow a user to sense less imagedamage.

FIG. 6 is a flowchart illustrating a video transmitting method of awireless transmitting apparatus, according to an exemplary embodiment.The operations outlined herein are exemplary and can be implemented inany combination thereof, including combinations that exclude, add, ormodify certain operations.

Referring to FIG. 6, in operation 610, the wireless transmittingapparatus 100 may verify channel state information of each of theplurality of wireless transmitters 120-1 and 120-2. For example, thechannel state information may include a PER. According to an aspect ofan exemplary embodiment, the plurality of wireless transmitters 120-1and 120-2 included in the wireless transmitting apparatus 100 mayreceive the channel state information from the plurality of wirelessreceivers 210-1 and 210-2 included in the wireless receiving apparatus200.

In operation 620, the wireless transmitting apparatus 100 may verifypixel partitioning information of at least one of the plurality ofwireless transmitters 120-1 and 120-2. For example, the pixelpartitioning information may be information indicating the configurationform (e.g., a ratio, a location, or the like) of actual data and dummydata included in the sub-stream to be transmitted to the wirelessreceiving apparatus 200. Operation 620 may be performed prior tooperation 610 or operation 620 and operation 610 may be performed at thesame time. In some embodiments, operation 620 may be skipped.

In operation 630, the wireless transmitting apparatus 100 may generate aplurality of sub-streams by using the video frame. The wirelesstransmitting apparatus 100 may generate a plurality of sub-streams basedon at least one of the channel state information and the pixelpartitioning information.

The wireless transmitting apparatus 100 may determine whether the videoframe is compressed and a compression rate, based on at least one of thechannel state information, the pixel partitioning information, and theresolution of the video frame. The wireless transmitting apparatus 100may determine an amount of data (or a load sharing rate) of the videoframe to be included in a plurality of sub-streams based on at least oneof the channel state information and the pixel partitioning information.The wireless transmitting apparatus 100 may determine the number ofsub-streams (or the total transmission period of the video frame) basedon at least one of the channel state information and the pixelpartitioning information. The wireless transmitting apparatus 100 maygenerate a plurality of sub-streams depending on the compression rate ofthe video frame, the number of video frames, and an amount of data ofthe video frame to be included in each of the plurality of sub-streams,which are determined. The wireless transmitting apparatus 100 maygenerate the sub-stream in consideration of a location at which dummydata is inserted by the pixel partitioning.

In operation 640, the wireless transmitting apparatus 100 may transmitthe plurality of sub-streams to the wireless receiving apparatus 200through the plurality of wireless transmitters 120-1 and 120-2. Thewireless transmitting apparatus 100 may transmit the plurality ofsub-streams to the wireless receiving apparatus 200 according to a WiHDstandard. After changing a plurality of sub-streams into sub-streams ofa first video format, the wireless transmitting apparatus 100 maytransmit the sub-streams of the first video format.

FIG. 7 is a flowchart illustrating a video reconstructing method of awireless receiving apparatus, according to an exemplary embodiment.

Referring to FIG. 7, in operation 710, the wireless receiving apparatus200 may receive a plurality of sub-streams from the wirelesstransmitting apparatus 100 through the plurality of wireless receivers210-1 and 210-2.

According to an aspect of an exemplary embodiment, in operation 720, thewireless receiving apparatus 200 may determine whether an error occursin at least one of the plurality of sub-streams. The wireless receivingapparatus 200 may determine whether an error has occurred in any of theplurality of sub-streams, by using a CRC code included in each of theplurality of sub-streams.

If the error has occurred in at least one of the plurality ofsub-streams, in operation 740, the wireless receiving apparatus 200 mayoutput an immediately-preceding video frame stored in the storage 225 toa display.

If the error has not occurred in any of the plurality of sub-streams, inoperation 730, the wireless receiving apparatus 200 may determinewhether the reception of a plurality of sub-streams constituting onevideo frame is completed.

If the reception of a plurality of sub-streams constituting one videoframe is not completed, in operation 740, the wireless receivingapparatus 200 may output the immediately-preceding video frame stored inthe storage 225 to the display.

If the reception of a plurality of sub-streams constituting one videoframe is completed, in operation 750, the wireless receiving apparatus200 may output the received video frame to the display. For example, thewireless receiving apparatus 200 may generate (or reconstruct) the videoframe by merging the plurality of sub-streams. The wireless receivingapparatus 200 may output the generated video frame to the display.

In operation 760, the wireless receiving apparatus 200 may store thereceived video frame in the storage 225. For example, the wirelessreceiving apparatus 200 may store the video frame, which is normallyreceived without an error, in the storage 225.

The term “module” used herein may include a unit, which is implementedwith hardware, software, or firmware, and may be interchangeably usedwith the terms “logic”, “logical block”, “component”, “circuit”, or thelike. The “module” may be a minimum unit of an integrated component or apart thereof or may be a minimum unit for performing one or morefunctions or a part thereof. The “module” may be implementedmechanically or electronically and may include, for example, anapplication-specific IC (ASIC) chip, a field-programmable gate array(FPGA), and a programmable-logic device for performing some operations,which are known or will be developed. Thus, various components,including modules, units, etc., of an apparatus as described herein maybe implemented by software, hardware, or a combination of both. Forexample, a data processor, a transmitter, a receiver, a generator, aconverter, a controller, a converter, a calculator, a merger, areconstructor, etc. may be implemented with at least one processor and acomputer-readable storage medium storing instructions which, whenexecuted by the processor, cause the processor to perform variousoperations.

According to various exemplary embodiments, at least a part of anapparatus (e.g., modules or functions thereof) or a method (e.g.,operations) may be, for example, implemented by instructions stored in acomputer-readable storage media in the form of a program module. Theinstruction, when executed by a processor, may cause the processor toperform a function corresponding to the instruction. Thecomputer-readable recording medium may include a hard disk, a floppydisk, a magnetic media (e.g., a magnetic tape), an optical media (e.g.,a compact disc read-only memory (CD-ROM) and a digital versatile disc(DVD), a magneto-optical media (e.g., a floptical disk)), an embeddedmemory, and the like. The instruction may include codes created by acompiler or codes that are capable of being executed by a computer byusing an interpreter. According to various exemplary embodiments, amodule or a program module may include at least one of the aboveelements, or a part of the above elements may be omitted, or otherelements may be further included.

According to various exemplary embodiments, a high-definition video maybe stably transmitted even though wireless channel quality is not good,by generating a sub-stream in consideration of the wireless channelstate.

According to various exemplary embodiments, a sub-stream may begenerated in consideration of a wireless channel state, as a result, ahigh-quality image may be stably received even when the wireless channelquality is poor and an occurrence of error in a video image may beeasily recognized.

According to various embodiments, a user may be less likely toexperience image degradation or image error even if an error occurs in areceived video image or reception of a video image is delayed.

According to various exemplary embodiments, operations executed bymodules, program modules, or other elements may be executed by asuccessive method, a parallel method, a repeated method, or a heuristicmethod, or at least one part of operations may be executed in differentsequences or omitted. Alternatively, other operations may be added.While the present disclosure has been shown and described with referenceto various exemplary embodiments thereof, it will be understood by thoseskilled in the art that various changes in form and details may be madetherein without departing from the spirit and scope of the presentdisclosure as defined by the appended claims and their equivalents.

What is claimed is:
 1. A wireless receiving apparatus comprising: aplurality of wireless receivers configured to receive a plurality ofsub-streams constituting a video frame; and a data processor configuredto: determine whether an error occurs in each of the plurality ofsub-streams; in response to determining that an error does not occur inany of the plurality of sub-streams and a reception of the plurality ofsub-streams constituting the video frame is completed within a totaltransmission period, merge the plurality of sub-streams to generate thevideo frame; transmit the video frame to a display that is electricallyconnected to the wireless receiving apparatus; and in response todetermining that an error occurs in at least one of the plurality ofsub-streams or the reception of the plurality of sub-streamsconstituting the video frame is not completed within the totaltransmission period, transmit an immediately-preceding video frame tothe display.
 2. The wireless receiving apparatus of claim 1, wherein thedata processor is further configured to: determine whether the receptionof the plurality of sub-streams constituting the video frame iscompleted by using total transmission period information and time indexinformation of a video frame included in a header of each of theplurality of sub-streams.
 3. The wireless receiving apparatus of claim2, wherein the data processor is further configured to, in response todetermining that the reception of the plurality of sub-streamsconstituting the video frame is not completed, temporarily store some ofthe plurality of sub-streams constituting the video frame in a memory.4. The wireless receiving apparatus of claim 3, wherein the dataprocessor is further configured to, in response to determining thatreception of a remainder of the plurality of sub-streams constitutingthe video frame is completed, merge some of the plurality of sub-streamstemporarily stored in the memory with the remainder of the plurality ofsub-streams to generate the video frame.
 5. The wireless receivingapparatus of claim 1, wherein the data processor is further configuredto verify channel index information included in a header of the each ofthe plurality of sub-streams and merge the plurality of sub-streams in acombination order based on the channel index information.
 6. Thewireless receiving apparatus of claim 1, wherein the data processor isfurther configured to differentiate a valid bit and a dummy bit of apayload of each of the plurality of sub-streams using pixel partitioninginformation included in a header of each of the plurality of sub-streamsand merge respective valid bits of the plurality of sub-streams togenerate the video frame.
 7. The wireless receiving apparatus of claim1, wherein the data processor is further configured to verify a positionof a cyclic redundancy check (CRC) code included in each of theplurality of sub-streams using payload length information included in aheader of each of the plurality of sub-streams and determine whether anerror occurs in each of the plurality of sub-streams using the CRC code.8. The wireless receiving apparatus of claim 1, wherein the dataprocessor is further configured to verify a compression rate of thevideo frame using compression rate information included in a header ofeach of the plurality of sub-streams, decompress the video frame tocorrespond to the compression rate, and transmit the decompressed videoframe to the display.
 9. The wireless receiving apparatus of claim 1,wherein the data processor is further configured to convert a format ofthe video frame to a format capable of being played in the display andtransmit the video frame, the format of which is converted, to thedisplay.
 10. A data processor comprising: a cyclic redundancy check(CRC) calculator configured to determine whether an error occurs in eachof a plurality of sub-streams received from a plurality of wirelessreceiving apparatuses; a stream merger configured to, in response todetermining that an error does not occur in any of the plurality ofsub-streams, merge the plurality of sub-streams to generate a videoframe; and a main controller configured to, in response to determiningthat an error does not occur in any of the plurality of sub-streams anda reception of the plurality of sub-streams constituting the video frameis completed within a total transmission period, transmit the videoframe to a display that is electrically connected to the wirelessreceiving apparatus, and in response to determining that an error occursin at least one of the plurality of sub-streams or the reception of theplurality of sub-streams constituting the video frame is not completedwithin the total transmission period, transmit an immediately-precedingvideo frame to the display.
 11. The data processor of claim 10, whereinthe stream merger is further configured to determine whether thereception of the plurality of sub-streams constituting the video frameis completed by using total transmission period information and timeindex information of a video frame included in a header of each of theplurality of sub-streams, and in response to determining that thereception of the plurality of sub-streams constituting the video frameis not completed, temporarily store some of the plurality of sub-streamsin a memory.
 12. The data processor of claim 11, wherein the streammerger is further configured to, in response to determining that thereception of a remainder of the plurality of sub-streams constitutingthe video frame is completed, merge some of the plurality of sub-streamstemporarily stored in the memory with the remainder of the plurality ofsub-streams to generate the video frame.
 13. The data processor of claim10, wherein the stream merger is further configured to verify channelindex information included in a header of each of the plurality ofsub-streams and merge the plurality of sub-streams in a combinationorder based on the channel index information.
 14. The data processor ofclaim 10, wherein the stream merger is further configured todifferentiate a valid bit and a dummy bit of a payload of each of theplurality of sub-streams using pixel partitioning information includedin a header of each of the plurality of sub-streams and merge respectivevalid bits of the plurality of sub-streams to generate the video frame.15. The data processor of claim 10, wherein the CRC calculator isfurther configured to verify a position of a CRC code included in eachof the plurality of sub-streams using payload length informationincluded in a header of each of the plurality of sub-streams, anddetermine whether an error occurs in each of the plurality ofsub-streams using the CRC code.
 16. The data processor of claim 10,further comprising: a decoder configured to verify a compression rate ofthe video frame using compression rate information included in a headerof each of the plurality of sub-streams, decompress the video frame tocorrespond to the compression rate, and transmit the decompressed videoframe to the display.
 17. The data processor of claim 10, furthercomprising: a video reconstructor configured to convert a format of thevideo frame to a format capable of being played in the display andtransmit the video frame, the format of which is converted, to thedisplay.
 18. The data processor of claim 10, further comprising: aplurality of stream converters configured to receive a plurality ofsub-streams from the plurality of wireless receiving apparatuses,convert a format of the plurality of sub-streams, and transmit theplurality of sub-streams, the format of which is converted, to the CRCcalculator.
 19. A video reconstructing method of a wireless receivingapparatus, the method comprising: receiving a plurality of sub-streamsconstituting a video frame; determining whether an error occurs in eachof the plurality of sub-streams; in response to determining that anerror does not occur in any of the plurality of sub-streams and areception of the plurality of sub-streams constituting the video frameis completed within a total transmission period, merging the pluralityof sub-streams to generate the video frame; transmitting the video frameto a display that is electrically connected to the wireless receivingapparatus; and in response to determining that an error occurs in atleast one of the plurality of sub-streams or the reception of theplurality of sub-streams constituting the video frame is not completedwithin the total transmission period, transmitting animmediately-preceding video frame to the display.